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Abstract 

■ In this note we improve a recent result by Arora, Khot, Kolla, Steurer, Tulsiani, and Vishnoi 

, on solving the Unique Games problem on expanders. 

Ol ' Given a (1 — e)-satisfiable instance of Unique Games with the constraint graph G, our 

algorithm finds an assignment satisfying at least a 1 — Ce/hc fraction of all constraints if 
e < c\q where Iiq is the edge expansion of G, \q is the second smallest eigenvalue of the 
Laplacian of G, and G and c are some absolute constants. 

We refer the reader to [TJ O HI [7] for the motivation and an overview of related work. 
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In this note we study the Unique Games problem on regular expanders. 



Definition 1.1 (Unique Games Problem). Given a constraint graph G = (V,E) and a set of 
permutations tt uv on the set [k] = {l,...,k} (for all edges (u,v)), the goal is to assign a value 
\& , ( state ) x u from [k] to each vertex u so as to satisfy the maximum number of constraints of the form 
Kuv( x u) = x v The cost of a solution is the fraction of satisfied constraints. 

^ . We assume that the underlying graph G = (V, E) is a d-regular expander. The two key pa- 

rameters of the expander G are the edge expansion Hq and the second eigenvalue of the Laplacian 
Xg- The edge expansion gives a lower bound on the size of every cut: for every subset of vertices 
X C V, the size of the cut between X and \V \ X \ is at least 



min(|X|,|U\X| 

It is formally defined as follows: 



>< : ho* ™ua . maij 

W \ v \ 



he = min 



\8{X,V\X)\ lmm{\X\,\V\X\ 



xcv V \E\ I \V\ 

here 5(X, V \ X) denotes the cut — the set of edges going from X to V \ X. One can think of the 
second eigenvalue of the Laplacian 



L G (u,v) 



1, if u = v 
-1/d, ]£(u,v)€E 
0, otherwise. 
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as of continuous relaxation of the edge expansion. Note that the smallest eigenvalue of L G is 0; 
and the corresponding eigenvector is a vector of all l's, denoted by 1. Thus 

. (x,L G x) 

AG = Him r—rp, — . 

x±i fII 

Cheeger's inequality, 

tia/8 < A G < h G , 

shows that h G and Ag are closely related; however Ag can be much smaller than h G (the lower 
bound in the inequality is tight). 

1.2 Results of Arora, Khot, Kolla, Steurer, Tulsiani, and Vishnoi 

In a recent work PQ, Arora, Khot, Kolla, Steurer, Tulsiani, and Vishnoi showed how given a (1 — e) 
satisfiable instance of Unique Games (i.e. an instance in which the optimal solution satisfies at 
least a (1 — e) fraction of constraints), one can obtain a solution of cost 

in polynomial time, here C is an absolute constant. We improve their result and show that, if the 
ratio s/X G is less than some universal positive constant c, one can obtain a solution of cost 

in polynomial time. As mentioned above, Ag can be significantly smaller than h G , then our result 
gives much better approximation guarantee. However, even if Ag ~ h G , our bound is asymptotically 
stronger, since 

1 - C'^- > 1 - C— 
h G A G 

(our bound does not have a log(AG/e) factor). It is an interesting open question, if one can replace 
the condition e/\ G < c with e/h G < c. 

1.3 Semidefinite Relaxation 

We use the standard SDP relaxation for the Unique Games problem. 

k 



minimize — \\uj, — i;„ 1 " 



2| f| Z / Z /ii"' 

(u,v)eE »=i 



subject to 



VueVVi,je[k],i^j (u i ,u j ) = G (1) 

k 

VueU ^|| ni || 2 = l (2) 



i=l 



Vn, v, w € V Vi, j, I G [k] \\u{ — wi\\ 2 < \\v,i — Vj\\ 2 + \\vj — wi\\ 2 (3) 
Vu, v & V Vi, j E [k] \\ui — Vj\\ 2 < \\ui\\ 2 + \\vj\\ 2 (4) 
Vn, v E V Vi, j G [fc] ||ni|| 2 < — t>j || 2 + || 2 (5) 
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For every vertex u and state i we introduce a vector itj. In the intended integral solution 114 = 1, 
if u has state i; and Uj = 0, otherwise. All SDP constraints are satisfied in the integral solution; 
thus this is a valid relaxation. The objective function of the SDP measures what fraction of all 
Unique Games constraints is not satisfied. 

2 Algorithm 

We define the earthmover distance between two sets of orthogonal vectors {ui, . . . , u^} and {v±, . . . , v k } 



here S k is the symmetric group, the group of all permutations on the set [k] = {1, . . . , k}. Given 
an SDP solution {ui} ui we define the earthmover distance between vertices in a natural way: 



Arora et al. [T] proved that if an instance of Unique Games on an expander is almost satisfiable, 
then the average earthmover distance between two vertices (defined by the SDP solution) is small. 
We will need the following corollary from their results: 

For every R G (0, 1), there exists a positive c, such that for every (1 — e) satisfiable instance of 
Unique Games on an expander graph G, if e/Xq < c, then the expected earthmover distance between 
two random vertices is less than R i.e. 



In fact, Arora et al. pQ showed that c > Q(R/ log(l/i?)), but we will not use this bound. Moreover, 
in the rest of the paper, we fix the value of R < 1/4. We pick cr, so that if e/Xc < cr, then 



as follows: 



k 




A(u, v) = A({m, ...,u k },{vi,..., v k }). 



E U) „ ey [A(u,v)\ < R. 



E UtVeV [A(u,v)] <R/4. 



(6) 




1. Triangle inequalities in for all vertices u, v, w in V and all states i, p, q in [k], 



U i ~ %\\\ + \\Vp ~ Wq\\l > \\Ui ~ Wg\\l. 



2. For all vertices u,v inV and all states i,j in [k] 



(Ui,Vj) 



{Ui,Vj} 




3. For all non-zero vectors Ui, \\uiW2 = 1- 
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4- For all uinV and i ^ j in [k], the vectors Ui and Uj are orthogonal. 
5. For all u and v in V and i and j in [k], 

1 1 ~ ~ 1 1 2 2 \\ V j ~ U i\\ 2 

\\Vj — U i 2 S TTj |9 ii rprT • 

maxdlujl^, ||u/|| z ) 

The set of vectors {ui} ui can be obtained in polynomial time. 

Now we are ready to describe the rounding algorithm. The algorithm given an SDP solution, 
outputs an assignment of states (labels) to the vertices. 

Approximation Algorithm 

Input: an SDP solution {ui\ ui of cost e. 
Initialization 

1. Pick a random vertex u (uniformly distributed) in V . We call this vertex the initial vertex. 

2. Pick a random state i € [k] for u; choose state i with probability ||iii|| 2 . Note that ||ui|| 2 + 
• • • + ||ufc|| 2 = 1. We call i the initial state. 

3. Pick a random number t uniformly distributed in the segment [0, ||uj|| 2 ]. 

4. Pick a random r in [R, 2R] . 
Normalization 

5. Obtain vectors {u%} ui as in Lemma 12.11 
Propagation 

6. For every vertex v, 

• Find all states p € [k] such that \\v p \\ 2 > t and \\v p — Ui\\ 2 < r. Denote the set of p's 
by S v : 

S v = {p '■ \\ v p\\ 2 > t and 1 1 t)p — ■u«|| 2 < r} . 

• If S v contains exactly one element p, then assign the state p to v. 

• Otherwise, assign an arbitrary (say, random) state to v. 

Denote by o~ vw the partial mapping from [k] to [k] that maps p to q if \\v p — w g || 2 < 4i?. Note 
that a vw is well defined i.e. p cannot be mapped to different states q and q': if \\v p — w q \\ 2 < AR 
and \\v p — w q '\\ 2 < 4i?, then, by the £ 2 triangle inequality (see Lemma 12.1( 1)). \\w q — w q /\\ 2 < 8R, 
but w q and w q i are orthogonal unit vectors, so 

\\Wq ~ Wq'\\ 2 = 2 > SR. 

Clearly, a vw defines a partial matching between states of v and states of w. if o~ vw (p) = q, then 
o- wv (q) = P- 
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Lemma 2.2. If p G S v and q G S w with non-zero probability, then q = o~ vw (p). 

Proof. If p G S v and q G S w then for some vertex u and state i, ||£>p — Ui\\ 2 < 2R and — ttj|| 2 < 2R, 
thus by the triangle inequality \\v p — w q \\ 2 < 4R and by the definition of a vw , q = o- vw {p). □ 

Corollary 2.3. Suppose, that p G S v , then the set S w either equals {a vw {p)} or is empty (ifcr vw (p) 
is not defined, then S w is empty). Particularly, if u and i are the initial vertex and state, then the 
set S w either equals {cr uw (i)} or is empty. Thus, every set S w contains at most one element. 

Lemma 2.4. For every choice of the initial vertex u, for every v G V and p G [k] the probability 
that p G S v is at most ||"Up|| 2 . 

Proof. If p G S v , then i = o~ vu (p) is the initial state of u and t < ||f p || 2 . The probability that both 
these events happen is 

Pr(z G S u ) xPr(t< \\v p \\ 2 ) = \\ui\\ 2 x min(||vp|| 2 /||ni|| 2 , 1) < \\v p \\ 2 

(recall that t is a random real number on the segment [0, ||tij|| 2 ])- □ 

Denote the set of those vertices v for which S v contains exactly one element by X. First, we 
show that on average X contains a constant fraction of all vertices (later we will prove a much 
stronger bound on the size of X). 

Lemma 2.5. If e/\g < cr, then the expected size of X is at least \V\/A. 

Proof. Consider an arbitrary vertex v. Estimate the probability that p G S v given that u is the 
initial vertex. Suppose that there exists q such that \\v p — u q \\ 2 < \\v p \\ 2 ■ R/2, then 

\\u - v II 2 < 2 \\ u i~ v p\\ 2 < R 

\\ a g u p\\ ^ /ii mo ii \\o\ — lh - 

m&x(\\Uq\\ z , J 

Thus, q = o~ vu {p) and ^\u q — -u p || 2 < r with probability 1. Hence, if q is chosen as the initial state 
and \\v p \\ 2 > t, then v p G S v . The probability of this event is ||it g || 2 x min(||z;p|| 2 /||'u (? || 2 , 1). Notice 
that 

9 \\ V II 2 

||u g || 2 x min(||z;p|| 2 /||iig|| 2 , 1) = min(||t;p|| 2 , ||uj 2 ) > ||wp|| 2 - \\u q - v p \\ 2 > p . 

Now, consider all p's for which there exists q such that \\v p — u q \\ 2 < \\v p \\ 2 ■ R/2. The probability 
that one of them belongs to S v , and thus v G X, is at least 

1 ^ „ „o lA„ „o 1 



H Kll 2 = ^ii^ii 2 -^ Yl l|r ' 



|2 

2 ^ "~ vn 2 ^"~"" 2 ^ " upl1 

p:min 9 (||ii 9 — i; p || 2 )<||i)p|| 2 -_R/2 p— 1 p:min q (||u 9 ~ti p || 2 )>||t;p|| 2 -_R/2 

k 



- \~\ x Y,^ m q [n (\\ u i- v p\\ 2 ) 

p=i 

> i a(M 9 ,m p ) 

- 2 R 

Since the average value of A({u} q , {v} p ) over all pairs (u, v) is at most Rj\ (see ©), the expected 
size of X (for random initial vertex u) is at least | V^|/4. □ 



5 



Corollary 2.6. Ifs/Xg < cr, then the size of X is greater than \V\/8 with probability greater than 
1/8. 



Lemma 2.7. The expected size of the cut between X and V \ X is at most 6e/R\E\. 

Proof. We show that the size of the cut between X and V\X is at most 6e/R\E\ in the expectation 
for any choice of the initial vertex u. Fix an edge (v, w) and estimate the probability that 
and w € V \ X . If v G X and w G V \ X, then S v contains a unique state p, but S w is empty (see 
Corollary 12. 3|) and, particularly, tt vw (p) ^ S w . This happens in two cases: 

• There exists p such that i = o~ vu (p) is the initial state of u and || 2 < t < \\v p \\ 2 . The 

probability of this event is at most 

k 

^K,4p)H 2 x 

p=l 



\ W Tr vm (p) I 



^^2\\ V P- W ^vw(p)\ 



There exists p such that i = a vu (p) is the initial state of u, t < ||f p || 2 and ||Ct, — v p \\ 2 < r < 
||ttj — w nvw ( p ) || 2 • The probability of this event is at most 



Ell 1 1 2 1 1 V P 1 1 

" u<Wp) " x K 

p—l II cr^u^JII 



< 



< 



< 



<?vu (p) W Kvw (P) 



II, 



k 

E 

p=l 

k 

Eli". 

p=l 

„ fc 



WpH X 



i? 



2 ll u p w vr„™(p)| 



i? 



2 IK - WawGOl 



#-max(||^|| 2 , IK^p)!! 2 ) 



i? 



P u/ 7r„ w (p)ll • 



p=l 



Note that the probability of the first event is zero, if H^V/p) || 2 > ||i> p || 2 ; and the probability of the 
second event is zero, if \\u Uvu (p) ~ v p \\ 2 > \\u avu { P ) ~ w nvw ( p )\\ 2 . 
Since the SDP value equals 



I k 

2\E\ S EK-^™ (p)H 2 
(D,>o)eBp=i 



The expected fraction of cut edges is at most 6e/R. 

□ 

Lemma 2.8. If e < hu^crAc, /iG-R/1000) ; i/ien with probability at least 1/16 the size of X is at 
least 



z iooex 

V h G Rj 



v\. 
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Proof. The expected size of the cut 5(X, V\X) between X and V \X is less than 6e/R\E\. Hence, 
since the graph G is an expander, one of the sets X or V \ X must be small: 

h G halt 

By Markov's Inequality, 

Pr(„(|X|,|ni|)<»>l-i 

Observe, that 100e/(/iGi?)|V r [ < |V|/8. However, by Corollary 12.61 the size of X is greater than 
|V|/8 with probability greater than 1/8. Thus 

/, v , 100e, A 1 

□ 

Lemma 2.9. The probability that for an arbitrary edge (v,w), the constraint between v and w is 
not satisfied, but v and w are in X is at most Ae VWl where 



- II _ ■ 1 2 



2 

8=1 

Proof. We show that for every choice of the initial vertex u the desired probability is at most &e vw . 
Recall, that if p G S v and q G S w , then q = a vw (p). The constraint between v and w is not satisfied 
if q 7^ tt V w(p)- Hence, the probability that the constraint is not satisfied is at most, 

p:ir vw (p)^£cr V vj(p) 

If 7T„ w (p) / (Tvwip), then 

II^-^Cp)!! 2 > -<„»( P )II 2 - \K - w* vw (j>)\\ 2 >2-4fl> 1. 

Hence, by Lemma 12. II (5), 

II«p - ^^(p)II 2 > IWI 2 / 2 - 

Therefore, by Lemma 12.41 



P-^vw(p)^0- vw (p) p.TTvw(p)^CT vw (p) P=l 



□ 



Theorem 2.10. There exists a polynomial time approximation algorithm that given a (1 — e) 
satisfiable instance of Unique Games on a d-expander graph G with e/Xq < c, the algorithm finds 
a solution of cost 

ho 

where c and C are some positive absolute constants. 
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Proof. We describe a randomized polynomial time algorithm. Our algorithm may return a solution 
to the SDP or output a special value fail. We show that the algorithm outputs a solution with a 
constant probability (that is, the probability of failure is bounded away from 1); and conditional 
on the event that the algorithm outputs a solution its expected value is 

Then we argue that the algorithm can be easily derandomized — simply by enumerating all possible 
values of the random variables used in the algorithm and picking the best solution. Hence, the 
deterministic algorithm finds a solution of cost at least ([7]). 

The randomized algorithm first solves the SDP and then runs the rounding procedure described 
above. If the size of the set X is more than 

the algorithm outputs the obtained solution; otherwise, it outputs fail. 

Let us analyze the algorithm. By Lemma 12.81 it succeeds with probability at least 1/16. The 
fraction of edges having at least one endpoint in V\X is at most 100e/ (JigR) (since the graph is d- 
regular). We conservatively assume that the constraints corresponding to these edges are violated. 
The expected number of violated constraints between vertices in X, by Lemma 12.91 is at most 



5 E 



Vx{\X\>ime/{h G R)) ~ 2 



< 64 x | - > llui-i^olr I <64e\E\. 
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The total fraction of violated constraints is at most 100e/ (hcR) + 64e. □ 
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